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IMPROVING CONTENT CONSISTENCY 
IN A DATA ACCESS NETWORK SYSTEM 



BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention pertains to data access network systems (e.g., 
Internet or intranet systems). More particularly, this invention relates to 
improving content consistency between a proxy server and a content server in a 
data access network system in a cost effective manner and with minimal 
network data traffic. 

2. Description of the Related Art 

An example of a data access network system is the Internet or an intranet 
network system. An Internet/intranet network system typically includes a 
number of data service systems and Internet Service Provider (ISP) systems 
connected together via interconnect networks. The data service systems 
typically include web content servers that host content for various customers or 
applications. The customers are the owners of the content hosted in the data 
service systems such that subscribers or users can access the content via their 
computer terminals via the ISP systems. The content owners are typically 
referred to as Content Providers. The data service systems may also be referred 
to as content servers. The content servers typically utilize Internet applications, 
such as electronic mail, bulletin boards, news groups, and World Wide Web 
access. The hosted content is arranged in the form of content sites within the 
content servers. Each site may include a number of pages (e.g., World Wide 
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Web pages). 

Access to the web pages by the users via their terminals is typically 
accomplished using the HTTP (Hyper Text Transfer Protocol) protocol. The 
HTTP protocol is a request-and-response protocol. When a user at a terminal 
(e.g., a personal computer) designates a particular web page, at least one request 
is generated. The actual number of requests is dependent upon characteristics of 
the designated web page. A web page may include one or more "objects" or 
files. A multi-object page can be more aesthetically pleasing than a plain page, 
but each object requires a separate request by the browser and a separate 
response by a server. 

The total time to download a Web page or other Internet document (e.g., 
an FTP file) depends on a number of factors, including the transmission speeds 
of communication links between a user terminal and a server on which the 
requested file is stored (i.e., content server), delays that are incurred at the 
server in accessing the document, and delays incurred at any intermediate device 
located between the user terminal and the content server, including the data 
access network. In addition, whenever a Web page or file is again requested by 
the same user terminal at a later time, the same download process may be 
repeated, which creates unnecessary and redundant network traffic in the data 
access network system. 

To reduce delay and network traffic, proxy servers are provided in the 
intermediate devices between the user terminals and the content servers to 
temporarily cache Web page files. This prior art arrangement is shown in Figure 
1 . An important benefit of employing the proxy server is the ability to cache 
objects received from the remote content servers. This allows the cached 
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objects to be quickly retrieved and sent to the client device if objects are again 
requested. Some of the cached objects may be requested by the same or 
different client device at later times. 

As can be seen from Figure 1, when a user terminal 12 generates a 
5 request for a particular object (e.g., the object 10 stored in the remote server 
18), the cache of the proxy server 16 in the local server 14 is searched to 
determine whether the object 10 is stored at the proxy server 16. If the object is 
not found in the cache of the proxy server 16, a "cache miss" results and the 
local server 14 directs the request to the remote server 18 via the Internet 20. 
LQ As can be seen from Figure 1, the remote server 18 stores the requested object 
^ 10. Once the remote server 18 receives the request, it directs a response with 
5] the requested object 10 to the client device 12 via the local server 14. During 
!f-H this process, the requested object 10 is also cached in the proxy server 16 of the 
*H local server 14. This eliminates the need for the local server 14 to send another 
1® request to the remote server 1 8 for the same object 10 at a later time when either 

iO 

P the same client device 12 or a different client device (not shown) requests the 
i3 same object 10. When the object 10 is again requested, the proxy server 16 is 
accessed and a "cache hit" results. In this case, the cached object 10 is quickly 
forwarded to the client device directly from the proxy server 16. This eliminates 

20 delays encountered in communicating between the proxy server 16 and the 

remote server 18. By storing copies of objects received from remote sites, the 
proxy server 16 reduces the number of requests that are directed to the remote 
server 18, as well as the traffic on the Internet 20 as a result of transmitting the 
responses in the form of a number of packets that must be reassembled at the 

25 client device 12. Caching can delay the need to provide additional network 
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resources, reduce peak demand on the network link from an ISP to the external 
Internet, and improve client response time. These factors lead to lower ongoing 
operating costs and increased user satisfaction. 

However, disadvantages are associated with this prior art caching 
arrangement. One disadvantage is that the prior art caching arrangement lacks 
content consistency between the contents stored in the proxy server and that 
stored in the content server. This means that if the content of an object or file 
stored in the content server is updated or otherwise changed, that change is not 
propagated to the proxy server that caches the same object. The proxy server 
has no way of knowing whether the content stored in the proxy server is 
consistent without querying the original content server. In this case, the cached 
and un-updated object from the proxy server, not the updated object from the 
remote content server, is retrieved by the user from the proxy cache when the 
object is requested. 

One prior art solution to this problem is to have the proxy server check 
the remote content server every time the proxy server is accessed. By doing so, 
the proxy server can assure that it serves consistent data to the users. This, 
however, comes at the cost of additional round trip connections to the origin 
content servers, which adds considerable delay to the servicing of the user 
requests. It also increases network traffic and the workload of the original 
content servers. This solution basically defeats many of the benefits of 
providing the proxy servers. 

Another prior art solution to this problem is to only cache an object in the 
proxy server for a predetermined time period. Within that time period, the proxy 
server serves every request for that object locally from its cache without 
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contacting the remote content server. After the time period has lapsed, the 
proxy server evicts the object from its cache. One disadvantage of this approach 
is that there is no content consistency assurance during the time period the 
object is cached in the proxy server because the object may be updated or 
changed during that time period. Another disadvantage is that after the time 
period, the object may still be the same even if it is evicted from the proxy 
server. This clearly will increase the network traffic when the same object is 
again requested. 
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SUMMARY OF THE INVENTION 



One feature of the present invention is to improve performance of a data 
access network system. Another feature is to improve performance of a web 
origin server. Another is to reduce user response time. 

Another feature of the present invention is to improve performance of a 
data access network system by maintaining content consistency between proxy 
server and content server. 

A further feature of the present invention is to improve performance of a 
data access network system by maintaining content consistency between proxy 
server and content server with minimized network traffic. 

A still further feature of the present invention is to reduce number of 
network connections to an origin by using a server-based content invalidation 
protocol. 

A data access network system is described that includes a content server 
coupled to a plurality of proxy servers via an interconnect network. The content 
server stores a set of content files. The data access network system also 
includes a system of maintaining content consistency between the content server 
and the proxy servers. The system includes a subscription manager in the 
content server that specifies all of the proxy servers that are subscribed to one of 
the content files. The system also includes a consistency manager that notifies 
all of the proxy servers that are subscribed to the content file to discard the 
cached content file from those proxy servers when the content file is updated in 
the content server. 

In addition, a method of maintaining content consistency between the 
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content server and the proxy servers is also described. The method includes the 
step of maintaining a subscription list for a content file in the content server that 
specifies all of the proxy servers that are subscribed to the content file. The 
method also includes the step of notifying, based on the subscription list, all of 
the proxy servers that are subscribed to the content file to discard the cached 
content file from those proxy servers when the content file is updated in the 
content server. 

Other features and advantages of the present invention will become 
apparent from the following detailed description, taken in conjunction with the 
accompanying drawings, illustrating by way of example the principles of the 
invention. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



. Figure 1 shows a prior art data access network system without content 
consistency mechanism. 

Figure 2 schematically illustrates a data access network system having a 
content consistency mechanism in accordance with one embodiment of the 
present invention. 

Figure 3 shows various protocol request headers of the web cache 
consistency protocol used in the data access network system of Figure 2 in 
accordance with one embodiment of the present invention. 

Figure 4 shows the operation of the web cache consistency protocol of 
Figure 3. 
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DETAILED DESCRIPTION OF THE INVENTION 



Figure 2 shows the structure or configuration of a data access network 
system 100 that implements a/content consistency scheme in accordance with 
one embodiment of the present invention. As will be described in more detail 
below, the content consistency scheme in accordance with one embodiment of 
the present invention employs a subscription manager (i.e., the subscription 
manager 40) in a data service system that contains content servers (i.e., the 
master data service system 30). The content servers in the master data service 
system 40 stores at least one content file, which can be accessed by remote 
proxy data service systems such as the proxy data service system 32. The 
subscription managey 40 in the master data service system 30 specifies all of the 
proxy servers (e.g., ihe proxy data service system 32) that consistently cache the 
content file and are subscribed to the cached content file. In addition, the 
content consistency scheme also employs a consistency manager (i.e., the 
consistency manager 41) to enforce the content consistency scheme. When the 
content of the content file is updated, deleted, or otherwise changed in the 
content servers of the master data service system 30, the consistency manager 
41 notifies all of the proxy data service systems that cache and are subscribed to 
the content file to discard the cached content file. 

In addition, each of the proxy data service systems also includes a 
subscription manager (e.g., the subscription manager 51). This subscription 
manager determines if content consistency is needed for the cached content file 
in the proxy data service system, and notifies the subscription manager 40 of the 
master data service system 30 if the content consistency (i.e., a subscription) is 
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determined to be needed for the cached content file. Moreover, each of the 
proxy data service systems also includes a consistency manager (e.g., the 
consistency manager 53) that discards or replaces the cached content file upon 
receiving the notification from the consistency manager 41 of the master data 
service system 30. The content consistency scheme and the data access network 
system 100 will be described in more detail below, also in conjunction with 
Figures 2-4. 

As can be seen from Figure 2, the data access network system 100 is an 
open-ended distributed or federated network system. The structure of the data 
access network system 100 is described below in order to provide a foundation 
upon which the present invention can be described in more. detail. 

In one embodiment, the data access network system 100 is an Internet 
network system. In another embodiment, the data access network system 100 is 
an Intranet network system. Alternatively, the data access network system 100 
may be any other known network system that employs a known communication 
protocol. 

As can be seen from Figure 2, the data access network system 100 
includes the proxy data service system 32 and the master data service system 30 
connected to the proxy data service system 32 via Internet (or Intranet) 31. As 
is known, the Internet 3 1 is a network system having a number of data service 
systems (similar to the data service systems 30 and 32) connected together via 
communication networks (not shown). Data communications among all data 
service systems are conducted using a predetermined communication protocol 
for Internet/Intranet communications. In one embodiment, the communication 
protocol is the Hyper Text Transport Protocol (HTTP). Alternatively, other 
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known communication protocols for Internet/Intranet communications can also 
be used. 

Figure 2 only shows one proxy data service system 32 and one master 
data service system 30 for the data access network system 100. This is for 
5 illustration purposes only. In practice, the data access network system 100 
includes a number of master and proxy data service systems. In addition, the 
master data service system 30 can also be connected to a number of proxy data 
service systems and the proxy data service system 32 can also be connected to a 
number of master data service systems. Moreover, the proxy data service 
10 system 32 can be both a proxy system and a master system in the data access 
^ network system 100, Likewise, the master data service system 30 can be both a 
master system and a proxy system in the data access network system 100. In 

^ this case, the master data service system 30 includes both the components 40-44 

W 

Wl and the components 50-54 of the proxy data service system 32. The proxy data 
1® service system 32 may also include both the components 50-54 and the 
O components 40-44 of the master data service system 30. 
^3 In Figure 2, the proxy data service system 32 is connected to a user 

terminal 33 via an interconnect network 34. This means that the proxy data 
service system 32 serves as the gateway to the Internet 31 or the master data 
20 service system 30 for the user terminal 33. Again, Figure 2 only shows one user 
terminal 33 for illustration purposes only. In practice, many more user terminals 
like the user terminal 33 can be connected to the proxy data service system 32. 

The user at the user terminal 33 can access the proxy data service system 
32 for the services provided by the data service system 32. The user at the user 
25 terminal 33 can also access the master data service system 30 for the services 
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provided by the data service system 30 via the proxy data service system 32 and 
the Internet 31. In this case, the data service system 30 is the master system of 
the user terminal 33 and the data service system 32 is the proxy system of the 
user terminal 33. If the data service system 30 is also connected with a user 
5 terminal (not shown) and the user at that user terminal wants to access the proxy 
data service system 32 for the services provided by the data service system 32 
via the master data service system 30 and the Internet 31, the data service 
system 30 becomes the proxy system for that user terminal and the data service 
system 32 becomes the master system for that user terminal. Thus, the terms 
"proxy" and "master" are relative terms, depending on the terminal referred to. 
The data service system 32 will be referred to as the proxy data service system 
and the data service system 30 will be referred to as the master data service 
f!j system below, with respect to the user terminal 33. In addition, the master data 
"* M service system 30 can also be referred to as the content server system (or 
iSj content server) and the proxy data service system 32 can also be referred to as 
4 the proxy server system (or proxy server). 

J| The user terminal 33 may be located at a residence, a school, or an office 

of the user. The user terminal 33 includes a network access application program 
(e.g., a web browser application program such as Netscape's Navigator or 

20 Communicator) that allows the user to access the data services offered by the 

data service systems 30 and 32. The user terminal 33 can be a computer system 
or other electronic device with data processing capabilities (e.g., a web TV). 
The interconnect network 34 can be any known network, such as Ethernet, 
ISDN (Integrated Services Digital Network), T-l or T-3 link, FDDI (Fiber 

25 Distributed Data Network), cable or wireless network or telephone line network. 
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Each of the data service systems 30 and 32 can be implemented in a 
computer system or other data processing system. The computer system that 
implements each of the data service systems 30 and 32 can be a server computer 
5 system, a workstation computer system, a personal computer system, or a 

mainframe computer system, a notebook computer system, or any other type of 
computer system. 

As a master data service system, the data service system 30 includes a 
content storage 43 that serves to store content files of the data service system 
1.0 30. In addition, the master data service system 30 includes a subscription 
JO manager 40, a consistency manager 41 , a core engine 42, and an object manager 
m 44. The components 40-44 are connected together. The components 42-44 
^ implement servers that offer data services (e.g., web, news, advertisement, e- 
W commerce, or e-mail) of the data service system 30. The servers include web 
1® servers, e-mail servers, news servers, e-commerce servers, domain name 
O servers, address assignment servers, and advertisement servers. The web 
i| servers, e-mail servers, news servers, e-commerce servers, and advertisement 

servers can be collectively referred to as local service servers or content servers. 
A content server typically stores a number of content files that include Hyper- 
20 Text Markup Language (HTML) web pages, GIF and/or JPEG images, video 
clips, etc. The content servers support a variety of Internet applications to 
provide services such as access to the World Wide Web, electronic mail, 
bulletin boards, chat rooms, news groups, and e-commerce. 

The content files are stored in the content storage 43 and are managed by 
25 the object manager 44. Data transfers to and from the content servers are 
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enabled by transport protocols such as Transport Control Protocol (TCP) and 
the User Datagram Protocol (UDP). The core engine 42 performs all the data 
processing and transfer function of the data service system 30. The components 
42-44 can be implemented using known technology. 

The subscription manager 40 and the consistency manager 41 of the 
master data service system 30 are employed for maintaining the content 
consistency between the content files stored in the content storage 43 of the 
master data service system 30 and the same content files cached in the caches 
(e.g., the cache 50) of all the proxy data service systems (e.g., the proxy data 
service system 32) in accordance with one embodiment of the present invention. 
This will be described in more detail below. The function and structure of the 
subscription manager 40 and the consistency manager 41 will also be described 
in more detail below. 

As a proxy system, the data service system 32 includes the cache 50 that 
serves to cache content files received in the proxy data service system 32. The 
content files cached in the cache 50 are received from, for example, the master 
data service system 30. In addition, the proxy data service system 32 includes 
the subscription manager 51, the consistency manager 53, a core engine 54, and 
an object manager 52. The components 50-54 are all connected together. 

The components 50, 52, and 54 implement a number of functional servers 
that perform the data service functions of the proxy data service system 32. The 
servers include web servers, e-mail servers, news servers, e-commerce servers, 
domain name servers, address assignment servers, advertisement servers, and 
proxy servers. The servers support a variety of Internet applications. Using a 
currently commercially available web browser and other client applications, the 
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users at their respective user terminals (e.g., the user terminal 33) can access the 
content files stored in the remote content servers (e.g., the content servers of the 
master data service system 30) via the proxy data service system 32. Data 
transfers to and from the servers in the data service system 32 are enabled by 
transport protocols such as Transport Control Protocol (TCP) and the User 
Datagram Protocol (UDP). The core engine 54 performs all the data processing 
and transfer function of the data service system 32. The components 50, 52, and 
54 can be implemented by known technology. 

The data service functions provided by the components 50, 52, and 54 
include the function of passing the access requests to the master data service 
system 30 (or to other data service systems), and the function of passing the 
requested content file from the master data service system 32 to the user 
terminal 33. In addition, the requested content file is also cached in the proxy 
servers of the proxy data service system 32 for future access. This eliminates 
the need for the core engine 54 in the proxy data service system 32 to send 
another request to the master data service system 30 for the same content file at 
a later time when a user terminal connected to the proxy data service system 32 
requests for the same content file. Instead, the core engine 54 in the proxy data 
service system 32 can access the cache 50 and a "cache hit" results. In this 
case, the content file is quickly forwarded to the user terminal that requests the 
content file. 

The subscription manager 51 and the consistency manager 53 of the 
proxy data service system 32 are employed for maintaining the content 
consistency between the content files stored in the master data service system 30 
and the same content files cached in the caches (e.g., the cache 50) of all the 
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proxy data service systems (e.g., the proxy data service system 32) in 
accordance with one embodiment of the present invention. This will be 
described in more detail below. The function and structure of the subscription 
manager 51 and the consistency manager 53 will also be described in more 
detail below. 

As described above, the data access system 100 of Figure 2 implements a 
content consistency scheme that maintains content consistency between the 
cached content file in the proxy data service system 32 and that stored in the 
content server of the master data service system 30. This content consistency 
scheme in accordance with one embodiment of the present invention is 
implemented through a publish/subscription mechanism which employs the 
subscription manager 40 and the consistency manager 41 in the master data 
service system 30 and the subscription manager 51 and the consistency manager 
53 of the proxy data service system 32. In addition, a new communication 
protocol is employed, which will be described in more detail below, also in 
conjunction with Figure 3 . 

Applying the content consistency scheme of the present invention, the 
content files cached in the proxy data service system 32 are guaranteed to be 
consistent with their counterparts stored in the remote master data service 
system 30 within a predetermined time interval. Assured consistency enables 
the proxy data service system 32 to serve the cached content files 
authoritatively, and reduces the need for consistency checking back to the origin 
content servers. This reduces the end user access latency and reduces load on 
the origin content servers because they do not have to serve consistency check 
requests. This also contributes to the improvement of the network bandwidth 
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demand. 

The new protocol for the content consistency scheme is built on the 
known HTTP protocol. As is known and as can be seen from Figure 3, the 
HTTP protocol includes a set of requests. They are HTTP GET, HTTP PUT, 
5 and HTTP GET IMS (If-Modified-Since). The new content consistency 
protocol includes a set of header extensions to the HTTP protocol, in one 
embodiment. These extensions are (1) the SUB header extension to the HTTP 
GET request, (2) a DWS INV message, (3) a DWS SUB header extension to the 
HTTP PUT publish method (see Figure 3), and (4) a DWS lease header 
tQ extension to the GET response. 

j7i The HTTP GET SUB request is used by the subscription manager 51 of 

]J[ the proxy data service system 32 to get a subscription in the master data service 

system 30 for the cached content file. The DWS INV message is sent by the 
a M consistency manager 41 of the master data service system 30 to all the proxy 
ts. data service systems on the subscription list maintained by the subscription 
H manager 40 of the master data service system 30 to discard the cached content 
% file in the proxy data service systems. The consistency manager 41 sends the 
DWS INV message to all of the proxy data service systems specified in the 
subscription list maintained by the subscription manager 40 when the content 
20 file specified by the subscription list is updated or deleted by its content 

provider. The HTTP PUT DWS SUB method not only notifies all of the proxy 
data service systems on the subscription list to discard the cached content file, 
but also sends the updated content file to those proxy data service systems. 

During operation, when the content file is retrieved from the master data 
25 service system 30 and cached in the proxy data service system 32, the 
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subscription manager 5 1 first determines if the content consistency scheme need 
to be applied to the cached content file. This can be done by determining, for 
example, if the cached content file is a popular content file or not. If the content 
file is determined to be a popular one, the subscription manager 5 1 then sends a 
subscription request to the subscription manager 40 of the master data service 
system 30 using the HTTP GET SUB request if it is determined that the content 
consistency is required for the cached content file in the proxy data service 
system 32. As described above, content consistency means that if a content file 
stored in the content server of the master data service system 30 changes or is 
deleted, the proxy data service system 32 that caches the same content file 
should be notified of the change such that the proxy data service system 32 can 
either discard the cached content file or get the updated version of the cached 
content file. 

When the subscription manager 40 of the data service system 30 receives 
the subscription request from the proxy data service system 32, the request is 
acknowledged and then may be added to a subscription list maintained by the 
subscription manager 40 in the master data service system 30 for the cached 
content file. The subscription list contains the return (notification) address of all 
the proxy data service systems that cache the content file. 

Each subscription request must be acknowledged by the master data 
service system 30 in its HTTP reply. The master data service system 30 first 
makes its decision on whether to allow or grant a subscription for the 
subscription request based on local policy (which can include the object's global 
popularity estimate, its size, modification history, and number of existing 
subscriptions to that content file). The master data service system 30 returns an 



-18- 



Atty. Dkt. No. 10981718 



acknowledgment with the HTTP reply indicating if the subscription request is 
allowed, and if so, for how long. 

The acknowledgment is in the form of a DWS-Lease response header 
field. Upon granting the subscription request, the subscription manager 40 of 
the master data service system 30 records the return (notification) address of the 
subscribing proxy data service system 32 within the meta-data of the cached 
content file in case it changes. 

Each subscription granted by the subscription manager 40 of the master 
data service system 30 is bounded by a predetermined monitoring time interval. 
This means that the content consistency scheme only guarantee content 
consistency between the data service systems 30 and 32 within a prescribed 
time interval. The consistency manager 41 of the master data service system 30 
will not generate an invalidation message upon modification or change to the 
cached content file after that predetermined monitoring time interval has 
elapsed. 

The predetermined time interval can be set either statically or based on an 
estimate of the time of the next modification (i.e., modification history of the 
cached content file). Each cached content file may have a time interval 
associated with it. All subscribing proxy data service systems will share the 
same monitoring time interval. After the time interval has expired (assuming no 
modification has taken place), the subscription manager 40 clears the 
subscription list, with no communication required between the master and proxy 
data service systems 30 and 32. The time interval provides a simple and robust 
method for limiting the amount of state that must be kept by the master data 
service system 30. It also provides a network-efficient mechanism for the clean- 
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up of the subscription list. 

If the cached content file is modified or updated during the monitoring 
time interval, the subscription manager 40 transfers the subscription list to the 
consistency manager 41 . The consistency manager 41 of the master data service 
system 30 then informs all the proxy data service systems currently listed on the 
subscription list to discard the cached content file. In this case, the consistency 
manager 41 sends a DWS INV message to each of the subscribing proxy data 
service systems contained in the subscription list. In addition, the consistency 
manager 41 can send the modified or updated content file to each of the 
subscribing proxy data service systems using the HTTP PUT DWS SUB 
publishing method. The consistency manager in each of the subscribing proxy 
data service systems (e.g., the consistency manager 53 of the proxy system 32) 
then either discards the cached content file or replaces it with the updated one 
just received from the master system 30. 

When the consistency manager 41 sends a notification (with or without a 
modified content file) to the proxy systems, each delivery from the consistency 
manager 41 of the master data service system 30 needs to be acknowledged by 
the consistency manager of each proxy system (e.g., the consistency manager 
53). If delivery fails, the consistency manager 41 will retry after a timeout, and 
repeat the retry periodically until successful or until the lease period expires, 
whichever is first. At that time, the consistency manager 41 will cease 
attempting to deliver the notification. 

Delivery of the notification to the subscribing proxy systems is 
accomplished using one of two protocols, under the control of the consistency 
manager 41 . The first protocol is the UDP protocol in which a notification 
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message packet is sent to a notification port of the proxy system (e.g., the proxy 
system 32). This port is communicated to the master system 30 during proxy-to- 
master authentication, which must precede any subscription. The second 
protocol is the HTTP protocol. Using this protocol, an HTTP POST request is 
made to the HTTP notification port of the proxy system. The message body 
carries the change request. The change request may include change notification 
messages for one or more content files that have changed or been deleted. 
Sending many change notifications in one request reduces overall network 
utilization and delay. 

Figure 4 depicts the interactions of the content consistency scheme in 
according to one embodiment of the present invention. The access request is 
from the user terminal 33 and is to be served by the proxy data service system 
32. The proxy system 32 makes a HTTP GET request (e.g., the request 60 in 
Figure 4) to get the first copy of the content file. On the next request, the proxy 
data service system 32 makes a HTTP GET IMS request (e.g., the request 61) to 
determine if the object has been modified (see Figure 4). This is required 
because the proxy system 32 assures the user at the user terminal 33 and the 
original content servers at the master data service system 30 that the content 
files it serves are consistent with what the content provider has published. On 
that or a subsequent HTTP GET IMS request (e.g., the SUB request 62), the 
proxy data service system 32 may request a subscription to the cached content 
file. As a result and if the master system 30 approves the request, the proxy 
system 32 is given/receives a time interval indicating the lease period for that 
content file. The proxy system 32 then serves all user requests during the time 
interval directly from the cache 50 without external communication to the master 
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data service system 30, as can be seen from Figure 4. 

After the lease interval elapses, the next user request for that cached 
content file causes the subscription manager 51 of the proxy system 30 to make 
another HTTP GET IMS request (e.g., the request 63) to the master system 30 
for that content file. The request causes the proxy system 32 either to get an 
updated copy of the content file (if it has been modified after the lease period 
has expired), or to identify that it has not been updated or modified since the last 
retrieval. During this GET EMS request, the proxy system 32 may re-request a 
subscription to the content file, as shown in Figure 4. 

If the content file is deemed to be extremely popular, the proxy system 32 
may request a subscription to the content file prior to the next user request (for 
example as soon as the prior lease interval expires). This is referred to as the 
active model. Using the passive model, the proxy system 32 only sends the 
subscription request when it receives the next user request for the cached 
content file. 

If the content file is updated by the content provider in the master data 
service system 30 during the lease period, the consistency manager 41 of the 
master system 30 will detect the modification and will send a DWS INV 
message (e.g., the message 64) to all subscribing proxy systems, including the 
proxy system 32 (see Figure 4). At that time, the subscription is cleared and no 
further invalidation message will be sent to the subscribing proxy systems for 
that content file unless a new subscription starts. 

When the proxy system 32 receives a DWS INV message, the 
consistency manager 53 must annotate the meta-data of the content file such that 
it will not serve the cached content file again from the cache 50 when the 
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content file is requested. This can include removing the content file from disk 
although this removal does not have to be synchronous with the request (it can 
be done at a quieter period or when disk space is next needed). Alternatively, 
the content file data can be maintained on disk and a delta encoding used to 
update the data when it is next requested. After an invalidation, the content file 
must not be served to the users because the content file may have been removed 
by its provider. 

In the foregoing specification, the invention has been described with 
reference to specific embodiments thereof. It will, however, be evident to those 
skilled in the art that various modifications and changes may be made thereto 
without departing from the broader spirit and scope of the invention. The 
specification and drawings are, accordingly, to be regarded in an illustrative 
rather than a restrictive sense. 
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